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© An interframe coding system which eliminates 

higher frequency components contained in an image 
^| signal effectively and adaptively with an adaptive 
^ filter provided in a coding loop. The adaptive filter 
qq eliminates the higher frequency components with the 
^ optimal filtering intensity for an image signal speci- 
00 fied with a filtering coefficient which is decided by a 
(V) filter controller. The filtering coefficient is decided by 
O normalization of the difference between an input 
CO image signal and a predictive signal from a frame 
O memory by the "Activity" of the input image signal 

or the predictive signal. The "Activity" can be based 
U upon the sum of the absolute or squared difference 

values based upon the mean value of luminance 

intensity of pixels of the image signal. 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

This invention relates to an image coding sys- 
tem, more specifically to an interframe coding sys- 
tem, wherein an image signal is coded on a frame- 
to-frame difference basis. 

2. Discussion of the Related Art 

It is a common practice to remove redundant 
components in an image signal for a highly effi- 
cient coding. Especially with a dynamic image sig- 
nal, an interframe coding is one of the preferable 
and typical arts. The interframe coding is a coding 
technique which codes a difference between a 
newly input uncoded image signal and a previously 
coded image signal. 

Fig. 40 is a block diagram of a conventional 
interframe coding apparatus disclosed in Japanese 
Unexamined Patent Publication No.208382/1 988. 
The interframe coding apparatus according to the 
figure has a frame memory 1, a motion-vector 
detector 2, a subtractor 3, an encoder 4, a local 
decoder 5, an adder 6, a filter 7 and a filter 
controller 8. The frame memory 1 stores an image 
signal of the previous frame. 

Operation of the conventional interframe coding 
system with a local decoding loop is now de- 
scribed with reference to the Fig. 40. 

The input image signal 12 is compared with 
the image signal of the previous frame 11 stored in 
the frame memory 1 by a block-matching tech- 
nique in the motion vector detector 2. The motion 
vector detector 2 detects the quantity and direction 
of motion of the input image signal 12 and outputs 
a motion vector signal 13. The frame memory 1 
outputs a motion compensation predictive signal 14 
based upon the motion vector signal 13. The sub- 
tractor 3 subtracts the motion compensation pre- 
dictive signal 14 from the input image signal 12 to 
output a predictive error signal 15 or a difference 
signal. 

The predictive error signal 15 is coded by 
quantization at the encoder 4, and a coded error 
signal 16 is output. The coded error signal 16 is 
decoded in the local decoder 5, and a local de- 
coded error signal 17 is output. The local decoded 
error signal 17 is added to the motion compensa- 
tion predictive signal 14 in the adder 6, and a local 
decoded signal 18 is output. The local decoded 
signal 18 is filtered by the filter 7 to eliminate 
higher frequency components in the signal. The 
filter smooths the local decoded signal and outputs 
a smoothed local decoded signal 19. Filtering is 
controlled by a control signal 20 output by the filter 
controller 8. The filter control signal 20 controls the 



filter based upon the motion vector signal 13. 

The coded error signal 16 and the motion 
vector signal 13 are transmitted via a transmission 
line to an external decoding system. 
5 Image coding is generally processed by the 

unit or block of 16x16 or 8x8 pixels of an image 
signal. 

With reference to other conventional coding 
techniques, the filter 7 can be placed after the 

w frame memory 1 in the local decoding loop instead 
of after the adder 6 as shown in Fig. 40. Further, 
filtering can be accomplished by an intra-block 
filter which processes pixels within a block, and by 
an inter-block filter which processes pixels involv- 
es ing the pixels in the neighboring blocks. Further- 
more, a motion detection can be achieved with a 
smaller unit of a pixel than a full pixel. This is 
designed to detect the optimal block of pixels in 
the previous frame which match a block of pixels in 

20 the input image signal 12. These conventional tech- 
niques can contribute to eliminate higher frequency 
components or redundancy in the input image sig- 
nal based upon the quantity of motion. Thus, they 
are effective for removing noise in the signal. Con- 

25 sequently, coding efficiency can be improved 
greatly with these conventional arts. 

An intraframe coding with a local decoding 
loop is processed in the following manner accord- 
ing to the conventional coding with reference to Fig 

30 1. The input image signal 12 is directly coded by 
quantization in the encoder 4, where the coded 
error signal 16 is output. The coded error signal 16 
is decoded in the local decoder 5, where the local 
decoded error signal 17 is output. The local de- 

35 coded error signal 17 is stored in the frame mem- 
ory 1. The coded error signal 16 is transmitted via 
a transmission line to an external decoding system. 

The conventional interframe coding generally 
controls filtering based upon the motion vector, 

40 whereby an image signal can be filtered based 
upon the quantity of motion. In other words, a block 
of pixels representing motion of an image signal, or 
a motion block, is filtered with a low-pass filter 
(LPF) thereby eliminating the original definition to 

45 eliminate noise in the signal. On the other hand, a 
block of pixels representing no motion or a very 
small amount of motion, is not filtered. 

Fig. 41 illustrates filtering different characteris- 
tics of the motion compensation predictive signal 

50 14 using the LPF in relation with luminance inten- 
sity (I) versus frequency (f). In the figure, 14a 
designates a characteristic of the image signal from 
the frame memory 1 without LPF filtering. 14b 
designates a characteristic of the image signal from 

55 the frame memory 1 after LPF filtering. 

In other words, a picture with no or little motion 
is unfiltered to keep its original definition as char- 
acteristic 14a shows. An image signal in motion is 
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filtered with the LPF reducing its original definition 
to eliminate higher frequency components in the 
signal as characteristic 14b shows. Thus, LPF filter- 
ing eliminates higher frequency components, des- 
ignated by the shaded portion in Fig. 41, in the 
image signal based upon the quantity of motion of 
the image signal. 

Fig. 42 illustrates LPF filtering characteristics of 
(a) the input image signal 12, (b) the motion com- 
pensation predictive signal 14a, and (c) the predic- 
tive error signal 15. When the motion compensa- 
tion predictive signal 14a can reproduce the input 
image signal 12 successfully, as shown in the 
figure, according to the excellent motion detection 
performance, the difference or the predictive error 
signal 15 between the two signals is small. Con- 
sequently, this can contribute to a higher coding 
efficiency because the amount of coding informa- 
tion is reduced. 

Accordingly, when a motion block of the mo- 
tion compensation predictive signal has a high 
quality of reproduction of the input image signal 
with the excellent motion detection performance 
and the difference between the two signals is very 
small, the block need not to be filtered. However, 
this does not apply to some cases: an image signal 
is filtered irrespective of the reproduction quality of 
the motion compensation predictive signal. 

When the motion compensation predictive sig- 
nal 14 is filtered with the LPF, the signal loses 
higher frequency components as shown in Fig. 41 . 
As a result, the difference between the input image 
signal and the filtered motion compensation predic- 
tive signal is the higher frequency components. In 
other words, a large amount of coding is needed 
thereby reducing the coding efficiency and result- 
ing in a low definition. 

Fig. 43 illustrates the characteristics of two 
input signals and one output signal at the subtrac- 
ter 3. Fig. 43(a) shows the characteristic of the 
input image signal 12, which corresponds to that of 
Fig. 42 (a). Fig. 43(b) shows the characteristic of 
the filtered motion compensation predictive signal 
14b in comparison to that of the unfiltered motion 
compensation predictive signal 14a. This shows 
that the higher frequency components (noise) in 
the signal with motion is eliminated by the LPF 
filtering. Fig. 43(c) shows the characteristic of the 
predictive error signal 15 which is the difference 
between the two input signals 12 and 14. The 
difference still contains the higher frequency com- 
ponents of the motion compensation predictive sig- 
nal 14. This requires the encoder to have to en- 
code bigger amounts of information leading to a 
lower coding efficiency. 

Thus, the problem is stemmed from the unnec- 
essary filtering as Figs. 42 and 43 illustrate. The 
motion compensation predictive signal 14 is not to 



be filtered when the signal has a high quality of 
reproduction due to a high detection performance 
of motion as shown in Fig. 42. When the motion 
compensation predictive signal 14 is filtered unnec- 
5 essarily under that condition as shown in Fig. 43, 
the image is damaged involving poor coding effi- 
ciency due to a higher amount of coding informa- 
tion or involving poor definition. 

The conventional interframe coding system 

10 carries another problem of quantization. Coding 
performance, according to the conventional sys- 
tem, is based upon a limited quantization which is 
designed optimally for a certain pattern of predic- 
tive error signal 15. In other words, the limited 

75 quantization can not deal effectively with coding 
signals of various patterns. When the encoder 
quantizes the signal with the limited quantization, 
the predictive error signal 15 is characterized with 
a poor coding efficiency and results in producing a 

20 poor coded error signal. 

The present invention is devoted to solve the 
problems. An objective of this invention is to pro- 
vide an interframe coding system with a high cod- 
ing efficiency by eliminating higher frequency com- 

25 ponents remaining in a coded signal. 

Another objective of this invention is to provide 
a coding controller which allows the encoder to 
code efficiently with coding signals of various pat- 
terns. This can lead to the overall coding efficiency 

30 of the interframe coding system. 

SUMMARY OF THE INVENTION 

An interframe coding system according to one 

35 aspect of the present invention for frame-to-frame 
coding of an input signal, having a local decoding 
loop which includes a filter for filtering a predictive 
signal, may include a filter controller for receiving 
the input signal and the predictive signal, and for 

40 generating a control signal to control the filter. 

The local decoding loop may includes decod- 
ing means for producing a previous input signal 
from a previous frame, a motion vector detector 
which receives the input signal and the previous 

45 input signal, and outputs a motion vector, and a 
frame memory for receiving the motion vector and 
the previous input signal and outputting a motion 
compensation predictive signal to the filter control- 
ler as the predictive signal. 

so The filter controller may include a difference 

calculator for receiving the input signal and the 
predictive signal, calculating a difference between 
the input signal and the predictive signal and out- 
putting a difference signal, a decision unit for re- 

55 ceiving the difference signal and the input signal, 
and for outputting the control signal, and wherein 
the filter may include a plurality of patterns of 
filtering coefficients and a means for selecting a 
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pattern of filtering coefficients based on the control 
signal. 

The decision unit may include means for cal- 
culating an activity value from the input signal, and 
means for normalizing the difference by the activity 
value and for outputting the control signal. 

The decision unit may include means for re- 
ceiving the predictive signal instead of the input 
signal, calculating an activity value from the predic- 
tive signal, and means for normalizing the dif- 
ference by the activity value and for outputting the 
control signal. 

The decision unit may include means for com- 
paring the difference signal and a predefined value, 
and issuing the control signal based on a compari- 
son result. 

The filter controller may include means for 
calculating a characteristic of the input signal, com- 
paring the characteristic with a predefined value, 
and issuing the control signal based on the com- 
parison result. 

The filter controller may include means for 
generating one of multiple values as the control 
signal to designate the pattern of filtering coeffi- 
cients of the filter. 

The filter may be any one of a one dimensional 
filtering means, a two dimensional filtering means 
or a three dimensional filtering means which in- 
cludes time axis as the third dimension. 

The filter may be placed either before or after 
the frame memory. 

In accordance with another aspect of the inven- 
tion, an interframe coding system for frame-to- 
frame coding of an input signal, having a local 
decoding loop which includes an encoder for inter- 
frame coding the input signal, decoding means for 
producing a decoded signal, and a frame memory 
which receives the decoded signal and outputs a 
predictive signal, may include a controller for re- 
ceiving the input signal and the predictive signal 
from the frame memory, for calculating a difference 
between the input signal and the predictive signal, 
and for generating a coding control signal for con- 
trolling the encoder. 

The controller may include a difference cal- 
culator for receiving the input signal and the pre- 
dictive signal for calculating a difference between 
the input signal and the predictive signal and for 
outputting a difference signal, a pixel difference 
calculator for receiving the difference signal, for 
calculating a value of the difference per each pixel, 
and for outputting the difference value per each 
pixel to the encoder, and wherein the encoder may 
include means for quantizing the input signal with a 
step size and for changing the step size of quan- 
tization so that coding error becomes smaller than 
the difference value per each pixel. 



The decoding loop may include a filter, and the 
controller may include means for generating a filter 
control signal to control the filter responsive to the 
input signal and the predictive signal. 

5 In accordance with yet another aspect of the 

invention, an interframe coding system for frame- 
to-frame coding of an input signal, having a local 
decoding loop which includes an encoder for inter- 
frame coding the input signal, decoding means for 

w producing a decoded signal, and a frame memory 
which receives the decoded signal and outputs a 
predictive signal, may include a controller for re- 
ceiving at least one of the input signal and the 
predictive signal, calculating an activity value from 

15 the received signals, and outputting an activity sig- 
nal to the encoder to control the coding therein. 

In accordance with yet another aspect of the 
invention, an interframe coding method for frame- 
to-frame coding of an input signal, wherein a cod- 

20 ing system includes a local decoding loop compris- 
ing a frame memory for receiving a decoded signal 
and outputting a predictive signal, a filter for receiv- 
ing and filtering the predictive signal, may include 
the steps of: 

25 (a) calculating the difference between the input 
signal and the predictive signal; 

(b) deciding a filtering coefficient of the filter 
based on the difference; and 

(c) filtering the predictive signal based on the 
30 filtering coefficient. 

In accordance with yet another aspect of the 
invention, an interframe coding method for frame- 
to-frame coding of an input signal, wherein a cod- 
ing system includes a local decoding loop compris- 

35 ing an encoder for interframe coding an input sig- 
nal, decoding means for producing a decoded sig- 
nal, a frame memory for receiving the decoded 
signal and outputting a predictive signal, and a filter 
for receiving and filtering the predictive signal, may 

40 include the steps of: 

(a) calculating a characteristic of the input sig- 
nal; 

(b) deciding a filtering coefficient of the filter 
based on the characteristic; and 

45 (c) filtering the signal based on the filtering 
coefficient. 

In accordance with yet another aspect of the 
invention, an interframe coding method for frame- 
to-frame coding of an input signal, wherein the 
so coding system includes a local decoding lop in- 
cluding an encoder for interframe coding an input 
signal, decoding means for producing a decoded 
signal, and a frame memory for receiving the de- 
coded signal and outputting a predictive signal, 
55 may include the steps of: 

(a) calculating the difference between the input 
signal and the predictive signal; 
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(b) changing a step size of quantization in the 
encoder responsive to the difference; and 

(c) coding the input signal based on the step 
size of quantization. 

In accordance with yet another aspect of the 5 
invention, an interframe coding method for frame- 
to-frame coding of an input signal, wherein the 
coding system includes a local decoding loop in- 
cluding an encoder for interframe coding the input 
signal, decoding means for producing a decodepl w 
signal, and a frame memory for receiving the de- 
coded signal and outputting a predictive signal, 
may include the steps of: 

(a) providing a characteristic signal indicating 
relative characteristic of one of the input signal 75 
and the predictive signal; 

(b) changing a step size of quantization in the 
encoder based on the characteristic signal; and, 

(c) coding the input signal based on the step 

size of quantization. 20 

In accordance with yet another aspect of the 
invention, a coding system which includes an en- 
coder for coding an input signal into a coded signal 
and a frame memory for outputting a predictive 
signal, may include a coding controller responsive 25 
to the input signal and the predictive signal, for 
generating a coding control signal for controlling 
the encoder. 

The coding controller may include means for 
interframe coding which produces an interframe 30 
signal, means for intraframe coding which produces 
an intraframe signal, means for determining char- 
acteristics of the interframe signal and the in- 
traframe signal, means for comparing the two char- 
acteristics, and means for generating the coding 35 
control signal based on the comparison result. 

The comparing means may include means for 
weighting at least one of characteristics. 

The coding system may further include a filter 
for receiving and filtering the predictive signal, and 40 
outputting a filtered signal, and a filter controller 
responsive to the input signal and the predictive 
signal for generating a filter control signal to control 
the filter. 

The coding controller may include means for 45 
interframe coding which produces a first interframe 
signal based on the filtered signal and a second 
interframe signal based on the unflltered predictive 
signal, means for intraframe coding which produces 
an intraframe signal, means for determining char- 50 
acteristics of the first and second interframe signals 
and the intraframe signal, means for comparing any 
two of the characteristic of the first interframe sig- 
nal, the characteristic of the second interframe sig- 
nal, and the characteristic of the intraframe signal, 55 
and means for generating the coding control signal 
based on the comparison result. 



The comparing means may include means for 
weighting at least one of characteristics. 

The coding controller may include means for 
interframe coding which produces an interframe 
signal based on the filtered signal, means for in- 
traframe coding which produces an intraframe sig- 
nal, means for determining a characteristic of the 
interframe signal and a characteristic of the in- 
traframe signal, means for comparing the two char- 
acteristics, and means for generating the coding 
control signal based on the comparison result. 

The comparing means may include means for 
weighting at least one of characteristics. 

The coding controller may include means for 
generating the coding control signal based on the 
coded signal, forming a feed back loop. 

The coding controller may include means for 
calculating a signal characteristic based on a dif- 
ference between the maximum and minimum val- 
ues of luminance intensity of pixels of the input 
signal, on the sum of the absolute difference values 
between the mean value of luminance intensity of 
the pixels and the individual values, or on the sum 
of the squared difference values between the mean 
value of luminance intensity of the pixels and the 
individual values. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a block diagram illustrating a con- 
figuration of an interframe coding system ac- 
cording to an embodiment of the present inven- 
tion; 

Fig. 2 shows a block diagram of a configuration 
of a filter controller in Fig. 1; 
Fig. 3 shows explanation diagrams of a block of 
pixels and equations of difference calculation 
according to the embodiment in reference to 
Fig. 1. 

Fig. 4 is an explanation diagram of the "Activity" 
of an image signal according to the embodiment 
with reference to Fig. 1 ; 

Fig. 5 is another explanation diagram of the 
"Activity" of an image signal according to the 
embodiment with reference to Fig. 1 ; 
Fig. 6 shows a flowchart of filtering control op- 
eration according to the embodiment in refer- 
ence to Fig. 1 . 

Fig. 7 shows a flowchart of another filtering 
control operation according to the embodiment. 
Fig. 8 shows a flowchart of another filtering 
control operation according to the embodiment. 
Fig. 9 is an explanation diagram of different 
filtering techniques of one-, two-, and three- 
dimensions according to the embodiment with 
reference to Fig. 1 ; 

Fig. 10 is an explanation diagram of intra- and 
inter-block filtering techniques according to the 
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embodiment with reference to Fig. 1; 
Fig. 11 is an explanation diagram of an opera- 
tion of an adaptive filter in Fig. 1; 
Fig. 12 is an explanation diagram of filtering 
characteristics of an image signal according to .5 
the embodiment with reference to Fig. 1 ; 
Fig. 13 shows a block diagram illustrating a 
configuration of an interframe coding system 
according to another embodiment of the present 
invention; 1Q 
Fig. 14 shows a block diagram illustrating a 
configuration of an interframe coding system 
according to another embodiment of the present 
invention; 

Fig. 15 shows a block diagram illustrating a 75 
configuration of an interframe coding system 
according to another embodiment of the present 
invention; 

Fig. 16 shows a block diagram illustrating a 
configuration of an interframe coding system 20 
according to another embodiment of the present 
invention; 

Fig. 17 shows a block diagram of a configuration 
of a filter controller according to the embodi- 
ment with reference to Fig. 16; 25 
Fig. 18 is an explanation diagram of an opera- 
tion of an encoder according to the embodiment 
with reference to Fig. 16; 

Fig. 19 shows a block diagram of a configuration 
of an interframe coding system according to 30 
another embodiment of the present invention; 
Fig. 20 shows a block diagram of a configuration 
of a controller according to the embodiment with 
reference to Fig. 19; 

Fig. 21 is an explanation diagram of frame and 35 
field according to another embodiment of the 
present invention; 

Fig. 22 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 40 
Fig. 23 shows a block diagram of a configuration 
of a coding controller according to the embodi- 
ment with reference to Fig. 22; 
Fig. 24 shows a block diagram of a configuration 
of a "Activity" comparative selector according to 45 
the embodiment with reference to Fig. 22; 
Fig. 25 shows a block diagram of a configuration 
of an Interframe coding system according to 
another embodiment of the present invention; 
Fig. 26 is an explanation diagram of weighting 50 
operated in a weighting circuit according to the 
embodiment with reference to Fig. 25; 
Fig. 27 shows a flowchart of the basic operation 
in the weighting circuit according to the embodi- 
ment. 55 
Fig. 28 shows a flowchart of an example of 
weighting operation in the weighting circuit ac- 
cording to the embodiment. 



Fig. 29 shows a flowchart of the basic operation 
in the comparator according to the embodiment. 
Fig. 30 shows a flowchart of the basic operation 
in the control signal generator according to the 
embodiment. 

Fig. 31 shows a memory table of the control 
signal generator according to the embodiment. 
Fig. 32 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 33 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 34 shows a block diagram of a configuration 
of a coding controller according to the embodi- 
ment. 

Fig. 35 shows a block diagram of a configuration 
of an "Activity" comparative selector according 
to the embodiment. 

Fig. 36 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 37 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 38 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 39 shows a block diagram of a configuration 
of an interframe coding system according to 
another embodiment of the present invention; 
Fig. 40 shows a block diagram of a conventional 
configuration of an interframe coding system; 
Fig. 41 shows basic characteristics of LPF filter- 
ing according to the conventional art; 
Fig. 42 shows a characteristic pattern of LPF 
filtering according to the conventional art; and, 
Fig. 43 shows another characteristic pattern of 
LPF filtering according to the conventional art. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Embodiment 1. 

Fig. 1 shows an interframe coding system in 
accordance with an embodiment of the present 
invention. Fig. 1 comprises Fig. 40 of the conven- 
tional art, as modified by adding a filter controller 
21 and an adaptive filter 22 and by removing the 
filter 7 and the filter controller 8 instead. The inter- 
frame coding system processes an image by a 
processing unit or block of 8x8 pixels according to 
this embodiment. 

Operation of the interframe coding system with 
a local decoding loop according to this embodi- 
ment is now described with reference to Fig. 1 . 
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An input image signal 12 is processed in a 
motion vector detector 2 with an image signal 1 1 of 
the previous frame stored in the frame memory 1 
to detect a motion vector. The frame memory gen- 
erates a motion compensation predictive signal 14 
based upon a motion vector signal 13. The inter- 
frame coding process corresponds so far to that of 
the conventional art. The motion compensation pre- 
dictive signal 14 is input in the filter controller 21 
together with the input image signal 12. The filter 
controller 21 generates a filter control signal 23. 

Operation of the filter controller 21 according to 
this embodiment is now described with reference 
to Figs. 1 through 5. 

Fig. 2 shows a configuration of the filter con- 
troller 21 in Fig. 1 which includes a difference 
calculator 30, a decision unit 31 and a difference 
signal 32. The difference calculator 30 basically 
calculates a difference between the input image 
signal 12 and the motion compensation predictive 
signal 14 to output the difference signal 32. Specifi- 
cally, the difference signal 32 is output in the 
following process: the difference calculator 30 cal- 
culates an absolute difference or squared differ- 
ence between the signals for each pixel Then the 
absolute values or squared values of pixel differ- 
ences are calculated for the processing unit or a 
block of 8x8 (64) pixels and output as the dif- 
ference signal 32. 

Fig. 3 shows explanation diagrams and equa- 
tions of difference calculation for the difference 
signal 32. Figs. 3(a) and 3(b) show a block or 
processing unit of 8x8 pixels of an image signal, 
respectively. Fig. 3(a) shows 64 pixels in a block of 
the input image signal 12 with each pixel repre- 
sented by S1 through S64. Fig. 3(b) shows 64 
pixels in a block of the motion compensation pre- 
dictive signal 14 with each pixel represented by Y1 
through Y64. Figs. 3(c) and 3(d) represent possible 
forms of. difference calculations of a luminance 
intensity of the pixels between the input image 
signal 12 and the motion compensation predictive 
signal 14 for the difference signal 32. Difference 
signal N in Fig. 3(c) is the sum of the absolute 
difference between the signals, while difference 
signal N in Fig. 3(d) is the sum of the squared 
difference between the signals. 

The value of the difference signal 32 becomes 
smaller when the predictive signal accurately pre- 
dicts performance of the system. The value be- 
comes larger, on the other hand, for the following 
possible cases: 

(a) for a poor predictive signal resulting from a 
poor prediction performance of the system; 

(b) where the input image signal has varied 
significantly from the previous image signal; 
and, 



(c) for a poor predictive signal resulting from a 
poor quality of the local decoded signal held in 
the frame memory 1 containing a large amount 
of quantization errors. 
5 The decision unit 31 calculates an "Activity" of 

the block of pixels of the input image signal 12 
responsive to the difference signal 32. The "Activ- 
ity" is based upon the difference, for instance, 
between the maximum and minimum values of the 
10 input image signal 12 as shown in Fig. 4. 

Fig. 4 is an explanation diagram of the "Activ- 
ity" illustrating that the "Activity" is based upon the 
difference between the maximum and minimum 
values of luminance intensity of pixels of the input 
75 image signal 12. The figure offers a brief explana- 
tion of the "Activity" by using only eight pixels 
instead of 64 pixels. The "Activity" of an image 
signal according to the figure is the difference 
value between the values of luminance intensity of 
20 the fourth pixel (maximum intensity) and of the fifth 
pixel (minimum intensity) in the eight pixels of the 
image signal. 

Fig. 5 shows another example of calculating 
the "Activity" of the image signal which can be 
25 either the sum of the absolute or squared dif- 
ference values between the mean value of lumi- 
nance intensity of the pixels and the individual 
values. 

Fig. 5(a) illustrates the "Activity" calculation of 

30 the mean value of luminance intensity of the pixels 
of the image signal. X1 through X8 in the diagram 
show the difference between the luminance inten- 
sity of the pixel and the mean value of luminance 
intensity of the eight pixels. Fig. 5(b) shows one of 

35 the calculation formulas of "Activity" X which is the 
sum of the absolute difference values of X1 
through X8. Fig. 5(c) shows another calculation 
formula of "Activity" X which is the sum of the 
squared difference values of X1 through X8. 

40 The "Activity" denotes, as shown in Figs. 4 

and 5, nothing like an absolute intensity but a 
relative value of an image signal. 

Specifically, "Activity" X becomes smaller with 
an image signal containing a large amount of lower 

45 frequency components, "Activity" X becomes larg- 
er with an image signal containing a large amount 
of higher frequency components. 

The difference signal 32 is normalized or di- 
vided by the "Activity" of the image signal in the 

so decision unit 31. A normalized result or value de- 
cides filtering intensity for eliminating higher fre- 
quency components in the image signal. The de- 
cision unit 31 generates the filter control signal 23 
specifying filtering intensity according to a normal- 

55 ized result. Specifically, when a normalized value is 
larger, indicating that the image signal contains a 
great amount of higher frequency components, the 
image signal is filtered with higher filtering inten- 
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sity. When a normalized value is smaller, on the 
other hand, indicating that the signal contains a 
large amount of lower frequency components, the 
image signal is filtered with lower filtering intensity. 
The decision unit 31 provides multiple values to the 
adaptive filter 22 for modifying the filtering intensity 
of the filter. The filter control signal 23 specifies 
filtering intensity of the image signal using one of 
the multiple values according to a normalized re- 
sult. 

The decision unit 31 according to this embodi- 
ment provides two values, for a brief explanation, 
indicating ON and OFF for controlling the filter with 
the filter control signal 23. In this case, a threshold 
value is to be set as a threshold for deciding 
whether the image signal is to be filtered or not. 
When a normalized value is larger than the thresh- 
old, the signal is to be filtered for eliminating higher 
frequency components and consequently reducing 
the amount of coding information. When a normal- 
ized value is smaller, on the other hand, than the 
threshold, the image signal is unfiltered in order to 
keep its original definition. 

Fig. 6 shows a flowchart of filtering control in 
the filter controller 21 controlling the filtering opera- 
tion (ON/OFF) with the motion compensation pre- 
dictive signal. 

The filter controller 21 controls filtering based 
upon data from the input image signal 12 and the 
motion compensation predictive signal 14. 

The following is the operating sequences of 
filtering control with an image signal: 

ST1. The adaptive filter is set OFF as an 
initial value. 

ST2. The difference calculator 30 calculates 
difference signal N between the input 
image signal 12 and the motion com- 
pensation predictive signal 14. 
ST3. The decision unit 31 calculates "Activ- 
ity" X of the input image signal 12. 
ST6. The decision unit 31 normalizes or di- 
vides difference signal N by "Activity" 
X of the input image signal. 
When a result of ST6 is smaller than a thresh- 
old value Th NX , indicating a successful prediction of 
an image signal, the motion compensation predic- 
tive signal is not to be filtered and the filter remains 
OFF. This indicates that difference signal N is 
smaller or "Activity" X is larger. In other words, the 
motion compensation predictive signal with a small- 
er value of difference signal N has reproduced the 
image successfully and therefore does not need to 
be filtered. On the other hand, the motion com- 
pensation predictive signal with a larger value of 
"Activity" X can indicate that the motion com- 
pensation predictive signal 14 contains a large 
amount of higher frequency components due to the 
original input image signal containing a large 
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amount of higher frequency components. The mo- 
tion compensation predictive signal, in this case, is 
not to be filtered. 

When a result of ST6 is larger than a threshold 

5 value Th NX , indicating a poor prediction of the 
image, the motion compensation predictive signal 
is to be filtered and the filter is turned ON. This 
indicates that the difference signal N is larger or 
that "Activity" X is smaller. In other words, the 

w motion compensation predictive signal with a larger 
value of the difference signal N due to a poor 
prediction, thus containing a large amount of higher 
frequency components. Therefore the motion com- 
pensation predictive signal, in this case, should be 

75 filtered in order to eliminate the higher frequency 
components for a highly efficient coding. On the 
other hand, the motion compensation predictive 
signal with a smaller value of "Activity" X is also to 
be filtered. However, there is a situation when the 

20 motion compensation predictive signal with a larger 
value of "Activity" X is not to be filtered. It is often 
the case when "Activity" X is larger, the motion 
compensation predictive signal 14 contains a large 
amount of higher frequency components. In this 

25 case the motion compensation predictive signal is 
not to be filtered keeping the higher frequency 
components with it, which can achieve a higher 
coding efficiency. 

Fig. 7 shows a flowchart of another filtering 

30 control method accomplished in the filter controller 
21. 

As ST4 in the figure shows, when difference 
signal N is larger than a first threshold value Th N , 
the filter is turned ON. This means that the motion 
35 compensation predictive signal contains a large 
amount of higher frequency components and there- 
fore is to be filtered in order to eliminate the higher 
frequency components to improve the coding effi- 
ciency. 

40 As ST5 in the figure shows, when "Activity" X 

is smaller than a second threshold value Th x , the 
filter is turned ON. This indicates that the input 
image signal 12 contains almost no higher fre- 
quency components. In other words, the motion 

45 compensation predictive signal with less or no 
higher frequency components cannot be influenced 
by filtering in terms of the elimination of higher 
frequency components and can still have more 
effective result with filtering rather than without 

so filtering in terms of the elimination of noise. On the 
other hand, when "Activity" X is larger than a 
threshold value Th x , the filter is not used (OFF). 
This indicates that the input image signal 12 con- 
tains a large amount of higher frequency compo- 

55 nents and, consequently, the motion compensation 
predictive signal 1 4 also contains a large amount of 
higher frequency components. In this case the mo- 
tion compensation predictive signal 14 remains un- 
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filtered keeping higher frequency components with 
it. 

Fig. 8 shows a flowchart of another filtering 
control method which can be executed in the filter 
controller 21 . Fig. 8 is a combination of Figs. 6 and 5 
7. The combination brings about a more adaptive 
control of filtering the image signal with many 
choices of threshold values available. 

With further reference to the embodiment, fil- 
tering control in accordance with the invention can 10 
be operated based on the comparison between the 
"Activity" of the input image signal and a threshold 
value Th x . In other words, the flowchart in Fig. 7 
can be altered by omitting the difference calcula- 
tion step ST2 and the comparison step ST4 be- 75 
tween N and Th x - 

When a division is operated by zero, the 
quotient is generally supposed to be infinite. This 
theory, however, does not apply to normalization 
here, for the calculation is generally with a finite 20 
length word. In other words, when a difference 
results from the difference calculator 30 is normal- 
ized by zero at ST6 in Fig. 6, a value of the 
"Activity", the quotient or normalized result is con- 
sidered the maximum value of the finite word used. 25 
Accordingly, when normalization uses an eight-bit 
operation, the quotient is "FF", which is the maxi- 
mum value of an eight-bit word, which is the maxi- 
mum normalized value. 

The adaptive filter 22 filters the motion com- 30 
pensation predictive signal 14 according to the 
filter control signal 23 for eliminating higher fre- 
quency components in the signal. As shown in Fig. 
9, the adaptive filter 22 can provide a multi-dimen- 
sional filtering including one-, two- and three-di- 35 
mensional filters. The three-dimensional filter can 
change the filtering coefficient based upon the mo- 
tion in an image signal as the frame varies with 
time. Filtering intensity of the adaptive filter can be 
varied according to the filtering coefficient specified 40 
by the filter control signal 23. 

Fig. 9 illustrates multi-dimensional low-pass fil- 
tering of the adaptive filter 22. Fig. 9(a) shows a 
one dimensional filtering of a line of pixels having a 
processing pixel as shown by a black dot in the 45 
processing unit or block of pixels. Fig. 9(b) shows 
horizontal and vertical lines of pixels in the block, 
and illustrates a two-dimensional filtering. Fig. 9(c) 
shows horizontal and vertical lines of pixels in 
blocks of time-varying frames t1 , t2 and t3, thereby . 50 
illustrating a three-dimensional filtering. 

Black dots in Fig. 9 indicate processing pixels. 
A processing pixel can be filtered with the influ- 
ence of the neighboring pixels according to any of 
the one-, two- , and three-dimensional filtering 55 
techniques. 

An image signal can be filtered either by an 
intra-block filtering, or by using pixels within the 



processing unit or block of 8x8 pixels exclusively, 
or by an inter-block filtering, or by using pixels in 
the neighboring blocks comprehensively as Fig. 10 
shows. 

Fig. 10 illustrates examples of the inter-block 
filtering with the processing pixel in a black dot. F1 
and F2 in the figure show, respectively, the inter- 
block filtering of the processing pixel by using 
pixels in the neighboring blocks. 

Fig. 1 1 is an explanation diagram illustrating a 
one-dimensional filtering. 

Fig. 11(a) shows five pixels, S1 through S5, for 
a one-dimensional filter, including a black dot, S3, 
as the processing pixel. K1 through K5 in the figure 
indicate filtering coefficients for each corresponding 
pixels S1 through S5 in the figure. The sum of the 
coefficients is 1.0 as shown in Fig. 11(b). 

Filtering intensity for the processing pixel is 
specified or decided by the result of the following 
calculation: the luminance intensity of each pixel of 
the processing pixel and the neighboring pixels S1 
through S5 is multiplied by a group of correspond- 
ing filtering coefficients k1 through K5. Each result 
of the multiplication is summed up. Figs. 11(c) and 
11(d) show different patterns of filtering coefficients 
K1 through K5 for the multiplication under the 
condition that the sum of the coefficients is 1.0. 
When the value of filtering coefficient of the pro- 
cessing pixel is not 1.0 (K3 = 0.6) or those of the 
neighboring pixels are non-zero 

(K1 =K2 = K4 = K5 = 0.1) as shown in Fig. 11(c), the 
luminance intensity of the processing pixel is influ- 
enced by those of the neighboring pixels to be 
normalized. When the value, of filtering coefficient 
of the processing pixel is 1.0 (K3 = 1.0) or those of 
the neighboring pixels are zero (K1 ,K2,K4,K5 = 0.0) 
as shown in Fig. 11(d), the luminance intensity of 
the processing pixel has no influence by those of 
the neighboring pixels keeping its original lumi- 
nance intensity. This indicates that the processing 
pixel is not to be filtered or the low-pass filter is to 
be OFF. 

Fig. 12 is an explanation diagram illustrating 
different characteristics of the predictive signal 24 
by different degrees of filtering intensity with dif- 
ferent filtering coefficients. The filter control signal 
23 specifies the optimal filtering intensity for the 
motion compensation predictive signal 14 to elimi- 
nate higher frequency components in the signal in 
a multiphase manner with multiple choices of the 
pattern of filtering coefficients. The four characteris- 
tic of the prediction signal, 24a through 24b, in the 
figure, indicate different filtering results by mul- 
tiphase elimination of higher frequency compo- 
nents in the signal with different patterns of filtering 
coefficients. Characteristic 24a shows that the mo- 
tion compensation predictive signal 14 is not fil- 
tered containing a great amount of higher frequen- 
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cy components. Characteristic 24d shows that the 
motion compensation predictive signal 14 is filtered 
containing a large amount of lower frequency com- 
ponents with very small portion of or no higher 
frequency components. The characteristics of the 
signal can be changed with different filtering coeffi- 
cients from 24a to 24d as an arrow A indicates if 
the predictive signal contains a large amount of 
higher frequency components. As an arrow B in- 
dicates, the characteristic can be changed from 
24d to 24a with different filtering coefficient if the 
signal requires higher definition. Generally, an im- 
age signal can keep its original resolution, its high- 
est definition, without filtering. 

When filtered the predictive signal 24 is sub- 
tracted from the input image signal 12 in a subtrac- 
ter 3, where a predictive error signal 15 is output. 
The predictive error signal 15 is coded by quan- 
tization in an encoder 4, where a coded error signal 

16 is output. The coded error signal 16 is decoded 
in a local decoder 5, where a local decoded error 
signal 17 is output. The local decoded error signal 

17 is added to the predictive signal 24 in an adder 
6, where a local decoded signal 18 is output. The 
local decoded signal is stored or written in the 
frame memory 1. 

Embodiment 2. 

With further reference to Fig. 1 , the interframe 
coding system in accordance with the invention 
can omit the motion vector detector 2 in terms of 
simplification of the system as shown in Fig. 13. In 
this case, the quantity of motion of an image signal 
is to be considered zero. 

Embodiment 3. 

With further reference to Fig. 1, the interframe 
coding system in accordance with the invention 
can provide the adaptive filter 22 after the adder 6 
in the local decoding loop instead of being after the 
frame memory 1, as is shown in Fig. 14. 

Embodiment 4. 

With further reference to Fig. 1 , the interframe 
coding system in accordance with the invention 
can combine the previous two embodiments. The 
interframe coding system omits the motion vector 
detector 2 and provides the adaptive filter 22 after 
the adder 6 in the local decoding loop instead of 
being after the frame memory 1, as is shown in 
Fig. 15. In Fig. 15 the motion vector detector 2 is 
not provided. Therefore, the interframe coding sys- 
tem with this configuration operates under the con- 
dition that the quantity of motion of an image signal 
is zero. 



Embodiment 5. 

Fig. 16 shows another configuration of the in- 
terframe coding system in accordance with the 

5 invention. The filter controller 21 outputs a pixel 
difference signal 25 or a control signal to the en- 
coder 4 as well as the filter control signal 23 to the 
adaptive filter 22. The pixel difference signal 25 is 
the difference per pixel which is calculated by 

10 dividing the value of the difference signal 32 by the 
number of pixels in a block of pixels (e.g. 8x8 = 64) 
in the filter controller 21. 

Fig. 17 shows a configuration of the filter con- 
troller 21 according to this embodiment. Fig. 17 

75 comprises Fig. 2, as modified by adding a pixel 
difference calculator 33 for calculating the pixel 
difference signal 25. The difference calculator 30 
outputs the difference signal 32 by the following 
way stated hereinbefore in reference to Fig. 2. The 

20 absolute or squared difference values of luminance 
intensity of pixels between the input image signal 
12 and the motion compensation predictive signal 
14 are summated within a block of pixels 
(8x8 = 64). 

25 The value of the difference signal 32 is divided 

in the pixel difference calculator 33 by the number 
of pixels in a block of pixels (8x8 = 64) to produce 
the average value of the difference signal 32 in 
order to output the pixel difference signal 25. The 

30 pixel difference signal 25 is the threshold value of 
quantization which is output to the encoder 4. The 
encoder 4 decides the optimal quantization step 
size for coding the image signal under the con- 
dition that qantizatidn error does not exceed the 

35 value of the pixel difference signal 25. 

Fig. 18 shows the pixel difference of an image 
signal illustrating the operation of deciding the 
quantization step size in the encoder 4 in accor- 
dance with this embodiment. 

40 In Fig. 18(a), D1 designates the pixel difference 

of a block containing eight pixels, D2 designates 
the pixel difference of another block of eight pixels, 
and D3 designates the pixel difference of another 
block of eight pixels. Those pixel differences are 

45 supposed to be given the following condition in the 
filter controller 21 as shown in Fig. 18(b): 
D1>D2>D3. 

When the pixel difference signal 25 is input 
into the encoder 4, the encoder 4 selects the 

50 optimal quantization step size for an input image 
signal based upon the pixel difference signal 25, so 
that the value of quantization error should be less 
than the value of the pixel difference signal 25. 
With D1 as the pixel difference signal 25, for in- 

55 stance, the encoder 4 selects a quantization step 
size SS1 (SSKD1), with D2 as the signal a step 
size SS2 (SS2<D2) is selected; and a step size 
SS3 (SS3<D3) is selected for D3. 

10 
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Under that condition, the encoder 4 quantizes 
an input image signal by selecting the optimal 
quantization step sizes based upon the value on 
the pixel difference signal 25 in the following rela- 
tions as shown in Fig. 18(d): SS1>SS2>SS3. 

Thus, the quantization step size becomes larg- 
er when the difference between the input image 
signal 12 and the motion compensation predictive 
signal 14 is large. On the other hand, the quantiza- 
tion step size becomes smaller when the difference 
between the two signals is smaller. Consequently 
this leads to a highly efficient coding performance 
minimizing the quantization error to have a high 
quality decoded image. 

The pixel difference signal 25 is not the only 
signal used to decided the quantization step size in 
the encoder 4. The quantization step size is also 
controlled or limited by the size of an output buffer 
which temporarily stores coded signals to be out- 
put from the encoder 4. The size of the buffer can 
limit the quantity of coding signals. In this case, the 
quantization step size is limited by the size of the 
output buffer. 

Embodiment 6. 

With further reference to Fig. 16, the interframe 
coding system in accordance with the invention 
can provide a controller 21a to output a control 
signal 25 to the encoder 4 for controlling the quan- 
tization step size. In this embodiment the adaptive 
filter 22 and the filter control signal 23 are not 
necessarily provided as shown in Fig. 19. 

Fig. 20(a) shows a configuration of the control- 
ler 21a according to this embodiment. Fig. 20(a) 
comprises Fig. 17, as modified by removing the 
decision unit 31. The operation of the difference 
calculator 30 and the pixel difference calculator 33 
corresponds to that described in reference to Fig. 
17. 

Fig. 20(b) shows another configuration of the 
controller 21a according to this embodiment pro- 
viding a decision unit 31a which outputs the control 
signal 25 of the "Activity" of an image signal. The 
"Activity" is calculated with the input image signal 
12 as shown in Figs. 4 and 5. 

The "Activity" of an image signal has a relative 
value, and not the absolute value, of luminance 
intensity of an image signal as stated hereinbefore. 
In other words, "Activity" X in Fig. 5 becomes 
smaller with an image signal containing a great 
amount of lower frequency components, while it 
becomes larger with an image signal containing a 
great amount of higher frequency components. 

Accordingly, the control signal of the "Activity" 
enables the encoder 4 to perform the optimal cod- 
ing by selecting flexibly the optimal quantization 
step size for an image signal. 



With further reference to Fig. 20(b), the de- 
cision unit 31b in accordance with the invention 
can have the motion compensation prediction sig- 
nal 14 as input information for calculating its "Activ- 
5 ity" as shown in Fig. 20(c). The overall operation of 
the decision unit 31b is equivalent with that de- 
scribed in Fig. 20(b). 

Embodiment 7. 

10 

With further reference to the embodiments 
hereinbefore, the frame memory 1 in accordance 
with the invention can store an image signal not by 
the frame but by the field as shown in Fig. 21. Fig. 

75 21 shows the relation between the frame and field 
of an image signal. Fig. 21(a) illustrates that the 
frame of an image signal is consisted of two fields 
of an image signal, the first and second fields. Fig. 
21 (b) illustrates a frame composed of the first and 

20 second fields of an image signal by using an 
interlace mode. 

With further reference to this embodiment, the 
filtering of an image signal can also be processed 
by the field. 

25 With further reference to the embodiments 

hereinbefore, the frame memory 1 in accordance 
with the invention can store a multiple number of 
time-varying frames or fields including the past, 
present, and forthcoming frames or fields. 

30 

Embodiment 8. 

With further reference to the embodiments 
hereinbefore with Figs. 2 and 17, the decision unit 
35 31 of the invention can use the motion compensa- 
tion predictive signal 14, instead of the input image 
signal 12, to calculate its "Activity" for normalizing 
the difference signal 32. 

40 Embodiment 9. 

Fig. 22 shows a configuration of interframe 
coding system according to another embodiment of 
the present invention. Fig. 22 comprises Fig. 1 , as 

45 modified by adding a coding controller 41, a cod- 
ing control signal 42 and a select signal 150, and 
by removing the adaptive filter 22, the filter control- 
ler 21 and the motion vector detector 2. 

Operation with the local decoding loop of the 

50 interframe coding system according to this embodi- 
ment is now described with reference to Fig. 22. 
The image signal 11 of the previous frame stored 
in the frame memory 1 or the local decoded image 
signal is used as a predictive signal. The subtractor 

55 3 subtracts the input image signal 12 from the 
predictive signal 11 to output the predictive error 
signal 15. The coding controller 41 calculates the 
"Activities" of the input image signal 12 and the 
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predictive error signal 15 to output the coding 
control signal 42 and the select signal 150, respec- 
tively, to the encoder 4. 

The encoder quantizes the select signal 150 to 
output the coded error signal 16. The local decoder 
5 decodes the coded error signal 16 to output the 
local decoded error signal 17. The adder 6 com- 
bines the local decoded error signal 17 with the 
image signal 11 to output the local decoded signal 
18. The local decoded signal 18 is stored in the 
frame memory 1. The coded error signal 16 is, on 
the other hand, also transmitted through a trans- 
mission line. 

Operation of the coding controller 41 in accor- 
dance with this embodiment is now described with 
reference to Fig. 23. The coding controller 41 has 
an "Activity" calculator 45, an "Activity" compara- 
tive selector 46, an "Activity" signal 12a based 
upon the input image signal 12, an "Activity" signal 
15a based upon the predictive error signal 15, the 
coding control signal 42 and the select signal 150. 

In the coding controller 41, the "Activity" cal- 
culator 45 calculates each "Activity" of the input 
image signal 12 and the predictive error signal 15 
to output their "Activities" to the "Activity" com- 
parative selector 46. 

The "Activity" of an image signal can be the 
difference between the maximum and minimum 
values of luminance intensity of pixels of a signal 
or the sum of the absolute or squared values of the 
difference between the mean value and the values 
of luminance intensity of a block of pixels in an 
image signal as stated hereinbefore with reference 
to Figs. 4 and 5. The "Activity" does not refer to 
the absolute luminance intensity of each pixel in an 
image signal. It involves a block of pixels of an 
image signal. When a block of pixels of an image 
signal contain a great amount of lower frequency 
components its "Activity" becomes smaller, while 
when they contain a great amount of higher fre- 
quency components its "Activity" becomes larger. 

In the "Activity" comparative selector 46, the 
"Activities" 12a and 15a are compared to select an 
optimal mode signal under a given priority based 
upon the user's or system's needs. The priority 
could be: 

(1) to prioritize coding efficiency; 

(2) to prioritize picture quality; or, 

(3) to put significance both on the coding effi- 
ciency and the picture quality and prioritize ei- 
ther of them if one has more significance de- 
pending on a given situation. 

There are more possible significant items can 
be added to the list of condition stated above, apart 
from coding efficiency and picture quality. Con- 
dition can be limited depending on the purpose or 
capacity of the system or the user's needs. When 
coding efficiency is prioritized, for instance, a mode 



signal of the image signal with smaller "Activity" 
by the comparison is output by the "Activity" com- 
parison selector 46 as stated hereinbefore. On the 
other hand, when picture quality is prioritized, the 

5 mode signal of the input image signal 12 is output 
by the "Activity" comparison selector 46. When 
both of coding efficiency and picture quality are 
prioritized, the "Activity" comparative selector 46 
outputs the mode signal of either the input image 

io signal 12 or the predictive error signal 15 based 
upon the comparison result of their "Activities" 
under a certain consideration. 

The "Activity" comparative selector 46 outputs 
the coding control signal 42 providing coding pa- 

75 rameters. The coding parameters include the quan- 
tization step size based upon the condition and the 
"Activities" of the image signals. The "Activity" 
comparison selector 46 also outputs the image 
signal selected by the mode signal as the select 

20 signal 150. 

Operation of the "Activity" comparative selec- 
tor 46 according to this embodiment is now de- 
scribed with reference to Fig. 24. The "Activity" 
comparative selector 46 has a weighting circuit 

25 46a, a comparator 46b and a control signal gener- 
ator 46c. The weighting circuit 46a weights the 
"Activity" of the input signal 12a and/or the "Activ- 
ity" of the predictive error signal 15a. The com- 
parator 46b compares the "Activity" of the input 

30 image signal 12a with the "Activity" of the predic- 
tive error signal 15a output from the weighting 
circuit 46a. The control signal generator 46c se- 
lects either the input image signal 12 or the predic- 
tive error signal 15 as the select signal 150 and 

35 also outputs the coding control signal 42 by mul- 
tiplexing the quantization step size, coding coeffi- 
cients, etc. The weighting circuit 46a will be left to 
the later discussion for a brief description of the 
"Activity" comparative selector 46 in this embodi- 

40 ment. Accordingly, the comparator 46b inputs the 
"Activity" of the input image signal 12a and the 
"Activity" of the predictive error signal 15a. The 
comparator 46b compares those "Activities" and 
outputs a mode signal 46m based upon the com- 

45 parison result to the control signal generator 46c. 
The mode signal 46m actuates a switch to input 
either the input image signal 12 or the predictive 
error signal 15 in the control signal generator 46c. 
The mode signal 46m is output as a part of the 

.so coding control signal 42 as one of the coding 
parameters included in the multiplexed signal to- 
gether with the quantization step size, discrete co- 
sine transform (DCT) coefficients, etc. to the en- 
coder 4. The encoder 4 demultiplexes and checks 

55 the multiplexed coding control signal 42, whereby 
the encoder 4 is informed, for instance with the 
mode signal, which signal is selected as the select 
signal 150 of the input image signal 12 and the 

12 
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predictive error signal 15. When the input image 
signal 12 is selected as the select signal 150, the 
encoder 4 performs "intraframe" coding, while the 
predictive error signal 15 is selected, the encoder 4 
performs "interframe" coding. Interframe and in- 
traframe codings are controlled by quantization 
step sizes and the OCT coefficients. 

Embodiment 10. 

With further reference to the previous embodi- 
ment referring to Fig. 22, the interframe coding 
system in accordance with the invention can have 
a filter controller, an adaptive filter and a motion 
vector detector as shown in Fig. 25. Accordingly, 
Fig. 25 comprises Fig. 22, as modified by adding 
the motion vector detector 2, the motion vector 
signal 13, the motion compensation predictive sig- 
nal 14, the filter controller 21, the adaptive filter 22, 
the filter control signal 23 and the predictive signal 
24. 

Operations of the motion vector detector 2, the 
filter controller 21 and the adaptive filter 22 cor- 
respond to those described in the first embodiment 
referring to Fig. 1. 

With further reference to Fig. 22, the predictive 
error signal 1 5 in accordance with the invention can 
be based partly upon the filtered predictive signal 
24 through the filter controller 21 and the adaptive 
filter 22 as shown in Fig. 25 instead of the image 
signal of the previous frame 11 unfiltered in Fig. 
22. In other words, the predictive error signal 15 is 
the subtracted result of the input image signal 12 
by the filtered predictive signal 24 in the subtractor 
3. Consequently, the coding controller 41 according 
to this embodiment compares the "Activity" of the 
input image signal 12 and the "Activity" of the 
filtered predictive error signal 15 to output the 
coding control signal 42. 

The filter controller 21 according to this em- 
bodiment calculates the difference between the in- 
put image signal 12 and the image signal from the 
frame memory 1 or the motion compensation pre- 
dictive signal 14. The filter controller 21 normalizes 
the difference by the "Activity" of either the input 
image signal 12 or the motion compensation pre- 
dictive signal 14. Accordingly, the optimal filtering 
intensity for the motion compensation predictive 
signal 14 is decided based upon the normalized 
result. This can contribute to a desirable elimination 
of higher frequency components in the image sig- 
nal leaving no higher frequency components in the 
prediction error signal, which leads to a high cod- 
ing efficiency. The coding control signal 42 accord- 
ing to this embodiment can be output by the cod- 
ing controller 41 based upon the mode signal. The 
mode signal is to select the image signal having 
smaller "Activity" of the two: the "Activities" of the 



input image signal 12a and the "Activity" of the 
optimally filtered prediction error signal 15a. This 
also contributes to a high coding efficiency. 

s Embodiment 11. 

With further reference to the previous two em- 
bodiments, the "Activity" comparative selector 46 
in the coding controller 41 in accordance with the 

70 invention can select the mode signal 46m based 
only upon the input signal resulted in the smallest 
"Activity" in the "Activity" comparison. Accord- 
ingly, the "Activity" comparative selector 46 out- 
puts the mode signal based upon the smallest 

75 "Activity" in the comparator and outputs the coding 
control signal 42 of coding parameter, including the 
quantization step size, etc. based upon the mode 
signal and the "Activity". 

An image signal with smaller "Activity" indi- 

20 cates that the image signal can be coded with 
higher coding efficiency in the encoder. 

Embodiment 12. 

25 With further reference to the previous two em- 

bodiments or Figs. 22 and 25, the "Activity" com- 
parative selector 46 in accordance with the inven- 
tion can weight "Activities" of the input signals, at 
least one of them, for comparison. 

30 The significance and operation of weighting 

"Activity" operated in the weighting circuit 46a in 
the "Activity" comparative selector 46 in Fig. 24 is 
now described with reference to Figs. 24 and 26. 
Fig. 26 shows the relation between the "Activities" 

35 of input signals and weighting. Fig. 26(a) shows the 
original "Activity" of the input image signal 12a and 
the original "Activity" of the predictive error signal 
with no weight added in the weighting circuit 46a. 
Fig. 26(b) shows the original "Activity" of the input 

40 image signal 12a with no weight added and the 
"Activity" of the predictive error signal with twice 
as much weight added as the original "Activity". 

Under the condition that the "Activity" com- 
parative selector 46 is to select the mode of an 

45 input signal with the smallest "Activity", the "Activ- 
ity" comparative selector 46 selects the predictive 
error signal 15 as the select signal 150 according 
to Fig. 26(a). The figure shows that the "Activity" of 
the predictive error signal 15a is constantly smaller 

so than the "Activity" of the input image signal 12a. 

Under that condition, the "Activity" compara- 
tive selector 46, on the other hand, selects either of 
. the signals alternatively of the input image signal 
12 or the predictive error signal 15 added a twofold 

55 weight on its. "Activity" 15b when it has smaller 
"Activity" than the other as the select signal 150 
according to Fig. 26(b). The figure shows that the 
predictive error signal 15 is selected during the 
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time period TO through T1 as the select signal 150. 
The input image signal 12 is selected during the 
time period T1 through T2 as the select signal 150 
due to the weighting on the predictive error signal. 

Fig. 27 shows a flowchart Of the basic opera- 
tion in the weighting circuit 46a according to the 
embodiment in reference to Fig. 24. When the 
weighting circuit 46a inputs the "Activity" of the 
input image signal 12a and the "Activity" of the 
predictive error signal (difference signal between 
the input image signal 12 and the predictive signal 
from the frame memory) 15a, the circuit reads out 
the previously assigned weighting coefficients W1 
and W2, respectively, for the signals. The input 
"Activities" of the signals 12a and 15a are multi- 
plied by the weighting coefficients W1 and W2, 
respectively, and a weighted "Activity" of the input 
image signal 12b and a weighted "Activity" of the 
predictive error signal 15b is output. 

With further reference to this embodiment, the 
weighting circuit 46a in accordance with the inven- 
tion can weight only one of the "Activities" of the 
input signals instead of both of them. 

With further reference to the embodiment, the 
weighting circuit 46a in accordance with the inven- 
tion can process three or more input signals, in- 
stead of two as described in this embodiment. An 
example of using three input signals in that con- 
dition will be described later in reference to Fig. 33. 

Fig. 28 shows a flowchart of an example of 
weighting operation in the weighting circuit 46a 
according to the embodiment in reference to Fig. 
26. In this example, the "Activity" of the input 
image signal 12a is not weighted and output as 
"Activity" 12b after the weighting circuit. The "Ac- 
tivity" of the predictive error signal 15a is doubled 
by the weight and output as its weighted "Activity" 
15b. 

Fig. 29 shows a flowchart of the basic opera- 
tion in the comparator 46b according to the em- 
bodiment in reference to Fig. 24. 

The comparator 46b compares the input "Ac- 
tivities" of the input image signal 12b and of the 
predictive error signal 15b from the weighting cir- 
cuit 46a to decide a coding mode. When "Activity" 
12b is smaller than "Activity" 15b, the comparator 
46b selects INTRA mode (for an intraframe coding) 
while the comparator selects INTER mode (for an 
interframe coding) when "Activity" 12b is larger 
than "Activity" 15b. When the comparator selects 
the mode, it outputs mode signal 46m to the con- 
trol signal generator 46c. 

With further reference to the embodiment, the 
weighting circuit 46a in accordance with the inven- 
tion can process three or more input signals, in- 
stead of two as described in this embodiment. An 
example of using three input signals in that situ- 
ation will be described later in reference to Fig. 33. 



Fig. 30 shows a flowchart of the basic opera- 
tion in the control signal generator 46c according to 
the embodiment in reference to Fig. 24. 

The control signal generator 46c inputs the 
5 input image signal 12, the predictive error signal 
15, the weighted "Activity" of the input image 
signal 12b, the weighted "Activity" of the predictive 
error signal 15b and the mode signal 46m. The 
control signal generator 46c outputs the control 

w signal 42 and one of the input signals as the select 
signal 150 based upon the mode signal 46m. The 
control signal generator 46c is informed of the 
selection of either the INTER or INTRA mode with 
the mode signal 46m. When the INTER mode is 

75 selected, the control signal generator outputs the 
predictive error signal 15 as the select signal 150. 
When the INTRA mode is selected, the control 
signal generator outputs the input image signal 12 
as the select signal 150. The control signal gener- 

20 ator 46c reads out the optimal quantization step 
size (QUANT) and the number of the DCT coeffi- 
cients in the memory table in Fig. 31 according to 
the weighted "Activity" of the selected signal 12b 
or 15b. The readout quantization step size 

25 (QUANT) and DCT coefficients as well as the mode 
signal 46m are multiplexed to be output as the 
control signal 42. 

With further reference to the embodiment, the 
control signal generator 46c in accordance with the 

30 invention can input the "Activity" of the input im- 
age signal 12a and the "Activity" of the predictive 
error signal 15a, instead of the weighted "Activi- 
ties" of those signals 12b and 15b. In this case, the 
threshold values or the contents of the memory 

35 table in Fig. 31 have to be altered. 

With further reference to the embodiment, the 
number of threshold value in Fig. 31 in accordance 
with the invention can be varied according to the 
assigned QUANT and DCT coefficients. The values 

40 of the QUANT and DCT coefficients can be also 
assigned based upon a given condition or priority, 
such as the picture quality or coding efficiency. 

Thus, selective, intentional control of an output 
signal, or the select signal 150 can be realized by 

45 the weighting technique. In other words, weighting 
can control the selection probability of input image 
signals in the "Activity" comparative selector 46. 
The select signal 150 can be controlled by weigh- 
ting technique which is provided with previously set 

50 weighting coefficients in the weighting circuit ac- 
cording to the user's or system's needs, or accord- 
ing to the picture quality desired. 

Embodiment 13. 

55 

With further reference to Fig. 25, the coding 
controller 41 in accordance with the invention can 
compare the "Activity" of the filtered predictive 
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error signal with the "Activity" of the unfiltered 
predictive error signal to output the coding control 
signal 42 based upon the compared result, specifi- 
cally, the signal with smaller "Activity". 

Fig. 32 shows a configuration of interframe 5 
coding system according to this embodiment pro- 
viding a predictive signal 24a filtered in the adap- 
tive filter 22 and a predictive signal 24b unfiltered 
or the motion compensation predictive signal 14. 
Those predictive signals 24a and 24b are sub- io 
tracted, respectively, from the input image signal 
12 in the subtractors 3a and 3b. The differences 
resulted from the subtraction are output as the 
predictive error signals respectively. The predictive 
error signals are compared in the coding controller 75 
41 to output the coding control signal 42 in the 
same manner described hereinbefore. 

Embodiment 14. 

20 

With further reference to Fig. 32 or the pre- 
vious embodiment, the coding controller 41 in ac- 
cordance with the invention can add weight on 
either or both of the "Activities" of the predictive 
error signals, filtered in the adaptive filter 22 or/and 25 
unfiltered, for comparison to output the coding con- 
trol signal 42. 

Embodiment 15. 

30 

With further reference to Fig. 32, the coding 
control signal 42 in accordance with the invention 
can be based upon the compared result among the 
"Activities" of three signals, the filtered predictive 
error signal and the unfiltered predictive error sig- 35 
nal, and the input image signal 12, specifically 
selecting the mode of the signal with the smallest 
"Activity". 

Fig. 33 shows a configuration of interframe 
coding system according to this embodiment. Fig. 40 
33 comprises Fig. 32, as modified by adding the 
input image signal 12 input in the coding controller 
41. The coding controller 41 uses three input sig- 
nals of the input image signal 12, the filtered pre- 
dictive error signal 1 5x and the unfiltered predictive 45 
error signal 15y for the "Activity" comparison to 
output the coding control signal 42 by selecting the 
mode of the signal with the smallest "Activity". 

Fig. 34 shows a block diagram of a configura- 
tion of the coding controller 41 according to the so 
embodiment. Fig. 34 comprises Fig. 23, as modi- 
fied by adding a filtered predictive error signal 15x 
and an unfiltered predictive error signal 15y, in- 
stead of the predictive error signal 15 and also 
adding an "Activity" of the filtered predictive error 55 
signal 15a and an "Activity" of the unfiltered pre- 
dictive error signal 15c. Therefore the coding con- 
troller 41 according to this embodiment inputs 



three signals, instead of two as described herein- 
before. The "Activity" calculator 45 calculates the 
"Activities" of the three signals and outputs the 
calculated result to the "Activity" comparative se- 
lector 46. Fig. 35 shows a block diagram of a 
configuration of the "Activity" comparative selector 
46 according to the embodiment. Fig. 35 com- 
prises Fig. 24, as modified by adding the filtered 
predictive error signal 15x, the unfiltered predictive 
error signal 15y, the "Activity" of the predictive 
error signal 15c, and a weighted "Activity" of the 
predictive error signal 15d. The three input "Activi- 
ties" of the signals in the "Activity" comparative 
selector 46 are added weight in the weighting cir- 
cuit 46a. Weighting coefficients W1 , W2, and W3 is 
assigned in the weighting circuit in advance. The 
weighting circuit adds weight by multiplying the 
"Activity" of input image signal 12a by a weighting 
coefficient W1 to output a weighted "Activity" of 
the input image signal 12b to the comparator 46b. 
In the same manner, the "Activity" 15a is multi- 
plied by W2 to have a weighted "Activity" 15b and 
the "Activity" 15c is multiplied by W3 to have a 
weighted "Activity" 15d. The comparator 46b com- 
pares the three weighted "Activities" to generate a 
mode signal 46m based upon the comparison re- 
sult. The control signal generator 46c selects one 
of the three signals as the output select signal 1 50, 
of the input image signal 12, the filtered predictive 
error signal 15x, and the unfiltered predictive error 
signal 15y based upon the mode signal 46m. When 
the input image signal 12 is selected for the select 
signal 150, the control signal generator 46c reads 
out a quantization step size and a DCT coefficient 
previously stored in the memory table according to 
the value of the weighted "Activity" of the input 
image signal 12b. When the filtered predictive error 
signal 15x is selected for the select signal 150, the 
control signal generator 46c reads out a quantiza- 
tion step size and a DCT coefficient in that manner 
as described hereinbefore based upon the value of 
the weighted "Activity" of the filtered predictive 
error signal 15b. When the unfiltered predictive 
error signal 15y is selected for the select signal 
150, the control signal generator 46c reads out a 
quantization step size and a DCT coefficient in that 
manner as described hereinbefore based upon the 
value of the weighted "Activity" of the unfiltered 
predictive error signal 15d. The readout quantiza- 
tion step size and DCT coefficient as well as the 
mode signal 46m are multiplexed to be output as 
the control signal 42. 

Embodiment 16. 

With further reference to Fig. 33 or the pre- 
vious embodiment, the coding controller 41 in ac- 
cordance with the invention can add weight on at 
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least one of the "Activities" of the three signals, the 
filtered predictive signal 15a, the unfiltered predic- 
tive error signal 15, and the input image signal 12 
for the "Activity" comparison to output the coding 
control signal 42 based upon the signal with the 
smallest "Activity". 

Embodiment 17. 

With further reference to the previous embodi- 
ment, the coding control signal 42 in accordance 
with the invention can be output based upon a 
mode signal derived from an image signal with 
smaller "Activity" compared between those of the 
filtered predictive error signal 15a and the input 
image signal 12a. 

Embodiment 18. 

With further reference to the previous embodi- 
ment, the coding controller 41 in accordance with 
the invention can add weight on either or both of 
the "Activities" of the filtered predictive error signal 
through the processing units or/and the input image 
signal 12 for comparison to output the coding con- 
trol signal 42. 

Fig. 36 shows a configuration of interframe 
coding system according to this embodiment. Fig. 
36 comprises Fig. 25, as modified by adding an- 
other input of the filter control signal 23 from the 
filter controller 21 into the coding controller 41. The 
filter control signal 23 is for a weighting control. 
The filter control signal informs the coding control- 
ler 41 of the condition of the predictive error signal 
15 whether it is filtered or not in the adaptive filter 
22. The control signal 23 is analyzed in the weigh- 
ting circuit 46a in the coding controller 41 to inform 
whether the adaptive filter 22 is ON or OFF. When 
the weighting circuit 46a knows that the predictive 
error signal 15 is based upon the predictive signal 
24 filtered in the adaptive filter 22, for example, it 
adds weight on the predictive error signal 15. 
When the weighting circuit 46a knows that the 
predictive error signal 15 is based upon the predic- 
tive error signal 24 unfiltered in the adaptive filter 
22, on the other hand, it does not add weight on 
the predictive error signal. Dynamic weighting con- 
trol can be realized with a variety of modes or 
values in the filter control signal 23 providing more 
than two modes of ON and OFF. 

Embodiment 19. 

With further reference to Fig. 25, the filter 
control signal 23 in accordance with the invention 
can be specified by a difference itself between the 
input image signal 12 and the image signal from 
the frame memory 1 without the normalization ac- 



tion process in the filter controller 21 . 

Embodiment 20. 

5 With further reference to Fig. 25, the filter 

control signal 23 in accordance with the invention 
can be specified based upon a difference between 
the input image signal 12 and the image signal 
from the frame memory 1 . 

10 

Embodiment 21. 

With further reference to Fig. 25, the filter 
controller 21 in accordance with the invention can 
15 output the filter control signal 23 by normalizing the 
difference between the input image signal 12 and 
an image signal from the frame memory 1 by the 
image signal from the frame memory 1 . 

20 Embodiment 22. 

With further reference to Fig. 25, the adaptive 
filter 22 in accordance with the invention can be 
provided after the adder 6 in the local decoding 

25 loop as shown in Fig. 37. The adaptive filter 22 
filters the local decoded signal 18 based upon the 
filter control signal 23 from the filter controller 21 . 
As a result, either the filtered or unfiltered local 
decoded signal is stored in the frame memory 1. 

30 The filtered, for instance, image signal 14 or pre- 
dictive signal 24 from the frame memory 1 is 
subtracted from the input image signal 12 in the 
subtractor 3 to output the predictive error signal 15 
for interframe coding. 

35 

Embodiment 23. 

The frame memory 1 in accordance with the 
invention can store an image signal by the field 
40 instead of the frame. The frame memory can also 
store a multiple number of time-varying frames or 
fields instead one frame or one field. 

Embodiment 24. 

45 

Fig. 38 shows a configuration of interframe 
coding system in accordance with the invention. 
Fig. 38 comprises Fig. 25, as modified by adding a 
coding-filtering controller 50 instead of providing 

50 separately the filter controller 21 and the coding 
controller 41 . Both of the filter controller and coding 
controller calculate the "Activity" of an image sig- 
nal in the same manner to control a signal and 
therefore it may be desirable to integrate them in 

55 terms of the concentration of the similar unit includ- 
ing the same function. Thus, the integrated control- 
ler of filtering and coding can provide more control 
efficient coding system and contribute to down- 
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sizing or minimization of the overall system. 

Embodiment 25. 

With further reference to Fig. 25, the motion . 
vector detector 2 in accordance with the invention 
can be removed from the system when the system 
prioritizes simplification. With this configuration, the 
quantity of motion of an image signal is always 
considered zero. 

Embodiment 26. 

With further reference to Figs. 22 through 38, 
coding control system jn accordance with the in- 
vention can provide a feedback loop based upon 
the coded data from the encoder 4 or the local 
error signal 16, adding to the coding controller 41 
or the filtering-coding controller 50. 

Fig. 39 shows a configuration of the interframe 
coding system according to this embodiment. Fig. 
39 comprises Fig. 22, as modified by adding a 
transmission buffer 100, a transmission signal 160 
and a feedback signal 101. The transmission buffer 
100 stores coded data from the encoder 4 based 
upon the coded error signal 16. The transmission 
signal 160 of the coded error signal 16 is transmit- 
ted onto a transmission line from the transmission 
buffer 100. The feedback signal 101 is fed back to 
the coding controller 41 from the transmission buff- 
er 100. 

Accordingly, the coding controller 41 controls 
coding with the coding control signal 42 by the 
feedback signal 101. The feedback signal 101 in- 
dicates, for instance, occupied ratio of coded error 
signals 16 in the transmission buffer 100. In recep- 
tion of the occupied ratio, the coding controller 41 
controls coding with the coding control signal 42 to 
reduce the amount coding in the encoder 4, for 
instance, when the coded error signal 16 occupies 
the transmission buffer 100 in larger proportion. On 
the contrary, the coding controller 41 controls cod- 
ing to increase the amount of coding in the en- 
coder 4 with the coding control signal 42, for in- 
stance, when the coded error signal 16 occupies 
the transmission buffer 100 in smaller proportion. 

Embodiment 27. 

With further reference to the foregoing embodi- 
ments, the "Activity" of an image signal in accor- 
dance with the invention can be represented in a 
variety of manners as a characteristic of the image 
signal. The foregoing embodiments provide the 
"Activity", a characteristic, of an image signal by a 
difference between image signals or by the sum of 
the absolute or squared difference values of an 
image signal vs. the mean value. There are other 



possible forms of the "Activity" of an image signal 
using other difference signals or the variance tech- 
nique. 

5 Embodiment 28. 

With further reference to the foregoing embodi- 
ments, the processing unit of image signal in ac- 
cordance with the invention can be a block of 
10 16x16, 32x32, or 8x16 pixels for example, instead 
of a block of 8x8 pixels. Otherwise, the processing 
unit can possibly be other forms, instead of a block 
of pixels. 

75 Embodiment 29. 

With further reference to the foregoing embodi- 
ments, a coding signal or coding data in accor- 
dance with the invention can be based upon radar 

20 signal or sound signal, instead of image signal. 

As described hereinbefore, one of the distinc- 
tive features of the interframe coding system of the 
present invention is that the filter controller normal- 
izes a difference between the input image signal 

25 and the signal from the frame memory by either 
the input image signal or the signal from the frame 
memory. The filter controller generates the filter 
control signal based upon the normalization to con- 
trol filtering intensity for eliminating higher frequen- 

30 cy components in the signal. The filter controller 
also generates the filter control signal based upon 
comparison between the "Activity" of the input 
image signal or of difference and a threshold value. 
Accordingly, filtering can be operated adaptively to 

35 each image signal, so that an image signal can be 
provided free from higher frequency components in 
the encoder for coding. This can contribute to a 
highly efficient coding leading to a high definition 
coded image even with motion. 

40 Another distinctive feature of the interframe 

coding system of the present invention is that the 
coding controller controls the quantization step size 
based upon one of the three signals which are a 
difference signal between the input image signal 

45 and the signal from the frame memory, the input 
image signal, and the signal from the frame mem- 
ory. This can contribute to reducing the amount of 
coding error in a coded image signal. 

Another distinctive feature of the present inven- 

50 tion is that the coding controller controls coding in 
the encoder by the mode signal based upon the 
signal with the optimal "Activity" or characteristic 
of either the input image signal or the predictive 
error signal. This can contribute to a highly efficient 

55 coding. 

As stated hereinbefore, the interframe coding 
system and method of the present invention have 
the following advantageous effects. 
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One of the advantageous features is that the 
filter controller controls filtering intensity for elimi- 
nating higher frequency components in an image 
signal by using the difference between the input 
image signal and the image signal from the frame 5 
memory, whereby an image signal can be provided 
free from higher frequency components in the en- 
coder leading to a highly efficient coding. 

Another advantageous feature is that filtering 
operation is designed to deal with any image sig- 10 
nals comprehensively including pictures with no or 
little motion and pictures with motion. Therefore 
pictures with motion can keep the original defini- 
tion, while pictures with no or little motion can 
acquire high definition coded image by eliminating 75 
higher frequency components in the signal. 

Another advantageous feature is that filtering 
can produce a highly coding efficient image signal 
by eliminating higher frequency components in the 
signal in the event that the predictive signal still 20 
contains a large amount of quantization error. 

Another advantageous feature is that filtering 
intensity can be altered in various degrees adapted 
to each image signal for a proper elimination of 
higher frequency components in the signal. This 25 
can provide a high quality predictive image for a 
highly efficient coding with a smaller coding loop 
gain. 

Another advantageous feature is that a pixel 
difference is used to control coding error, so that a 30 
decoded image can carry less coded error. This 
can contribute to a highly efficient prediction for the 
forthcoming frames of an image signal. 

As stated hereinbefore, the interframe coding 
system and method of the present invention also 35 
have the following advantageous effects. 

One of the advantageous features is that the 
coding controller outputs the coding control signal 
based upon the "Activities" of the input image 
signal and the predictive error signal. This can 40 
improve coding efficiency. 

Another advantageous feature is that the cod- 
ing controller adds weight on the "Activity" of an 
input image signal. The coding controller can con- 
trol the output ratio of an image signal as the select 45 
signal from the coding controller in accordance 
with a user's or system's needs or the condition of 
the processing image signal. 

Another advantageous feature is that filtering 
control and coding control are designed to deal 50 
with any image signals comprehensively including 
pictures with no or little motion and pictures with 
motion. Therefore pictures with motion can keep 
the original definition, Awhile pictures with no or 
little motion can acquire high definition coded im- 55 
age by eliminating higher frequency components in 
the signal. 



Another advantageous feature is that filtering 
can produce a highly coding efficient image signal 
by eliminating higher frequency components in the 
signal in the event that the predictive signal still 
contains a large amount of quantization error. Fur- 
ther, the coding controller outputs the coding con- 
trol signal based upon the signal with the smallest 
"Activity" among others, so that the coding effi- 
ciency can be improved. 

Another advantageous feature is that the cod- 
ing controller outputs the coding control signal 
based upon the mode signal by selecting the im- 
age signal with the smallest "Activity" among oth- 
ers. This can improve the coding efficiency by 
providing a highly efficient prediction with less cod- 
ing loop gain. 

Claims 

1- An interframe coding system for frame-to- 
frame coding of an input signal, having a local 
decoding loop which includes a filter for filter- 
ing a predictive signal, the interframe coding 
system comprising: 

a filter controller for receiving the input 
signal and the predictive signal, and for gen- 
erating a control signal to control the filter. 

2. The interframe coding system of claim 1, 
wherein the local decoding loop includes de- 
coding means for producing a previous input 
signal from a previous frame; 

a motion vector detector which receives 
the input signal and the previous input signal, 
and outputs a motion vector; and 

a frame memory for receiving the motion 
vector and the previous input signal and out- 
putting a motion compensation predictive sig- 
nal to the filter controller as the predictive 
signal. 

3. The interframe coding system of frame 1, 
wherein the filter controller comprises: 

a difference calculator for receiving the 
input signal and the predictive signal, calculat- 
ing a difference between the input signal and 
the predictive signal and outputting a differ- 
ence signal; 

a decision unit for receiving the difference 
signal and the input signal, and for outputting 
the control signal; and 

wherein the filter includes a plurality of 
patterns of filtering coefficients and a means 
for selecting a pattern of filtering coefficients 
based on the control signal. 

4. The interframe coding system of claim 3, 
wherein the decision unit includes means for 
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calculating an activity value from the input sig- 
nal; and 

means for normalizing the difference by 
the activity value and for outputting the control 
signal. 

5. The interframe coding system of claim 3, 
wherein the decision unit includes means for 
receiving the predictive signal instead of the 
input signal, calculating an activity value from 
the predictive signal; and 

means for normalizing the difference by 
the activity value and for outputting the control 
signal. 

6. The interframe coding system of claim 3, 
wherein the decision unit includes means for 
comparing the difference signal and a 
predefined value, and issuing the control signal 
based on a comparison result. 

7. The interframe coding system of claim 1, 
wherein the filter controller includes means for 
calculating a characteristic of the input signal, 
comparing the characteristic with a predefined 
value, and issuing the control signal based on 
the comparison result. 

8. The interframe coding system of claim 3, 
wherein the filter controller includes means for 
generating one of multiple values as the con- 
trol signal to designate the pattern of filtering 
coefficients of the filter. 

9. The interframe coding system of claim 8, 
wherein the filter is any one of a one dimen- 
sional filtering means, a two dimensional filter- 
ing means or a three dimensional filtering 
means which includes time axis as the third 
dimension. 

10. The interframe coding system of claim 9, 
wherein the filter is placed either before or 
after the frame memory. 

11. An interframe coding system for frame-to- 
frame coding of an input signal, having a local 
decoding loop which includes an encoder for 
interframe coding the input signal, decoding 
means for producing a decoded signal, and a 
frame memory which receives the decoded 
signal and outputs a predictive signal, the in- 
terframe coding system, comprising: 

a controller for receiving the input signal 
and the predictive signal from the frame mem- 
ory, for calculating a difference between the 
input signal and the predictive signal, and for 
generating a coding control signal for control- 



ling the encoder. 

12. The interframe coding system of claim 11, 
wherein the controller includes a difference 

5 calculator for receiving the input signal and the 

predictive signal for calculating a difference 
between the input signal and the predictive 
signal and for outputting a difference signal; 
a pixel difference calculator for receiving 

w the difference signal, for calculating a value of 

the difference per each pixel, and for output- 
ting the difference value per each pixel to the 
encoder; and 

wherein the encoder includes means for 

15 quantizing the input signal with a step size and 

for changing the step size of quantization so 
that coding error becomes smaller than the 
difference value per each pixel. 

20 13. The interframe coding system of claim 11, 
wherein the decoding loop includes a filter, 
and the controller includes means for generat- 
ing a filter control signal to control the filter 
responsive to the input signal and the predic- 

25 tive signal. 

14. An interframe coding system for frame-to- 
frame coding of an input signal, having a local 
decoding loop which includes an encoder for 

30 interframe coding the input signal, decoding 

means for producing a decoded signal, and a 
frame memory which receives the decoded 
signal and outputs a predictive signal, the in- 
terframe coding system further comprising: 

35 a controller for receiving at least one of the 

input signal and the predictive signal, calculat- 
ing an activity value from the received signals, 
and outputting an activity signal to the encoder 
to control the coding therein. 

40 

15. An interframe coding method for frame-to- 
frame coding of an input signal, wherein a 
coding system includes a local decoding loop 
comprising a frame memory for receiving a 

45 decoded signal and outputting a predictive sig- 

nal, a filter for receiving and filtering the pre- 
dictive signal, the interframe coding method 
comprising the steps of: 

(a) calculating the difference between the 
so input signal and the predictive signal; 

(b) deciding a filtering coefficient of the filter 
based on the difference; and 

(c) filtering the predictive signal based on 
the filtering coefficient. 

55 

16. An interframe coding method for frame-to- 
frame coding of an input signal, wherein a 
coding system includes a local decoding loop 
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comprising an encoder for interframe coding 
an input signal, decoding means for producing 
a decoded signal, a frame memory for receiv- 
ing the decoded signal and outputting a pre- 
dictive signal, and a filter for receiving and 5 
filtering the predictive signal, the interframe 
coding method comprising the steps of: 

(a) calculating a characteristic of the input 
signal; 

(b) deciding a filtering coefficient of the filter 10 
based on the characteristic; and 

(c) filtering the signal based on the filtering 
coefficient. 

17. An interframe coding method for frame-to- 75 
frame coding of an input signal, wherein the 
coding system includes a local decoding loop 
including an encoder for interframe coding an 
input signal, decoding means for producing a 
decoded signal, and a frame memory for re- 20 
ceiving the decoded signal and outputting a 
predictive signal, the interframe coding method 
comprising the steps of: 

(a) calculating the difference between the 
input signal and the predictive signal; 25 

(b) changing a step size of quantization in 
the encoder responsive to the difference; 
and 

(c) coding the input signal based on the 
step size of quantization. 30 

18. An interframe coding method for frame-to- 
frame coding of an input signal, wherein the 
coding system includes a local decoding loop 
including an encoder for interframe coding the 35 
input signal, decoding means for producing a 
decoded signal, and a frame memory for re- 
ceiving the decoded signal and outputting a 
predictive signal, the interframe coding method 
comprising the steps of: 40 

(a) providing a characteristic signal indicat- 
ing relative characteristic of one of the input 
signal and the predictive signal; 

(b) changing a step size of quantization in 

the encoder based on the characteristic sig- 45 
nal; and, 

(c) coding the input signal based on the 
step size of quantization. 

19. A coding system which includes an encoder 50 
for coding an input signal into a coded signal 

and a frame memory for outputting a predictive 
signal, comprising: 

a coding controller responsive to the input 
signal and the predictive signal, for generating 55 
a coding control signal for controlling the en- 
coder. 



20. The coding system of claim 19, wherein the 
coding controller comprises: 

means for interframe coding which pro- 
duces an interframe signal; 

means for intraframe coding which pro- 
duces an intraframe signal; 

means for determining characteristics of 
the interframe signal and the intraframe signal; 

means for comparing the two characteris- 
tics; and 

means for generating the coding control 
signal based on the comparison result. 

21. The coding system of claim 20, wherein the 
comparing means includes means for weigh- 
ting at least one of characteristics. 

22. The coding system of claim 19, further com- 
prising: 

a filter for receiving and filtering the pre- 
dictive signal, and outputting a filtered signal; 
and 

a filter controller responsive to the input 
signal and the predictive signal for generating 
a filter control signal to control the filter. 

2a The coding system of claim 22, wherein the 
coding controller comprises: 

means for interframe coding which pro- 
duces a first interframe signal based on the 
filtered signal and a second interframe signal 
based on the unfiltered predictive signal; 

means for intraframe coding which pro- 
duces an intraframe signal; 

means for determining characteristics of 
the first and second interframe signals and the 
intraframe signal; 

means for comparing any two of the char- 
acteristic of the first interframe signal, the char- 
acteristic of the second interframe signal, and 
the characteristic of the intraframe signal; and 

means for generating the coding control 
signal based on the comparison result. 

24. The coding system of claim 23, wherein the 
comparing means includes means for weigh- 
ting at least one of characteristics. 

25. The coding system of claim 22, wherein the 
coding controller comprises: 

means for interframe coding which pro- 
duces an interframe signal based on the fil- 
tered signal; 

means for intraframe coding which pro- 
duces an intraframe signal; 

means for determining a characteristic of 
the interframe signal and a characteristic of the 
intraframe signal; 
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means for comparing the two characteris- 
tics; and 

means for generating the coding control 
signal based on the comparison result. 

5 

26. The coding system of claim 25, wherein the 
comparing means includes means for weigh- 
ting at least one of characteristics. 

27. The coding system of claim 19, wherein the w 
coding controller includes means for generat- 
ing the coding control signal based on the 
coded signal, forming a feed back loop. 

28. The coding system of claim 20, 23, or 25, is 
wherein the coding controller includes means 

for calculating the characteristic based on a 
difference between the maximum and mini- 
mum values of the signal, on the sum of the 
absolute difference values between the individ- 20 
ual values and the mean value of the individual 
values, or on the sum of the squared dif- 
ference values between the individual values 
and the mean value of the individual values. 

25 
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